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A TRANSFORMATION METHOD FOR CONSTRAINED- FUNCTION MINIMIZATION 


Stephen K. Park 
Langley' Research Center 

SUMMARY 

A direct method for constrained-function minimization is discussed. The method 
involves the construction of an appropriate function mapping all of one finite dimensional 
space onto the region defined by the constraints. Functions which produce such a trans- 
formation are constructed for a variety of constraint regions including, for example, those 
arising from linear and quadratic inequalities and equalities. In addition, the computa- 
tional performance of this method is studied in the situation where the Davidon-Fletcher- 
Powell algorithm is used to solve the resulting unconstrained problem. Good performance 
is demonstrated for 19 test problems by achieving rapid convergence to a solution from 
several widely separated starting points. 

INTRODUCTION 

One popular method for solving a constrained-function minimization problem is to 
reformulate the problem - by various devices - as an equivalent unconstrained problem. 
This, for example, is the philosophy underlying the method of penalty functions. In this 
report an alternate philosophy is discussed — namely, that of providing an equivalent 
unconstrained problem by way of a transformation in the space of independent variables. 

As an example, suppose F is a function of n real parameters xj^, X 2 , . . ., x^ 
and it is desired to minimize F subject to a collection of equality and inequality 
constraints. Let X in R*^ denote the set of points x = ^xj, X 2 , . . ., x^j which 
(simultaneously) satisfy all the constraints. A transformation in the space of independent 
parameters involves the construction of a function 9 which maps rP (for an appropriate 
integer p) onto X. 

If such a function 9 can be constructed, it provides a representation of each of the 
n constrained parameters x = ^x^, X 2 , . . •> in. X in terms of p unconstrained 
parameters, say z = (zi, Z 2 , • • •> Zpj in R^. Consequently, by way of the parameter 
transformation x = 0(z), the original constrained problem becomes the equivalent problem 
of minimizing f(z) = F(0(z)) subject to no constraints. 
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The procedure just outlined is referred to as the (parameter) transformation method. 
It is clear that this is not a general-purpose method applicable to all problems but rather 
a fairly specialized one applicable only when X has a reasonably simple structure. How- 
ever, the method remains attractive since many important types of constraints give rise 
to rather simple constraint regions and since it allows for considerable ingenuity on the 
part of the user. 

In the late 1950 's and early 1960 's simple transformations were occasionally used to 
reformulate optimal control problems with bounded control variables as equivalent calculus 
of variations problems. (See, e.g., refs. 1 to 3.) This procedure is now known to yield 
the same information as a direct application of the Pontryagin Maximum Principle. Con- 
sequently, the procedure is rarely used now to analyze control problems mathematically. 
However, it is used in the numerical solution of optimal control problems — at least in 
those situations where the control variables are merely bounded above or below (or both). 

Surprisingly, transformation methods received no attention in the mathematical pro- 
graming literature (except, in passing, in ref. 4) until Box's 1966 paper (ref. 5). Since that 
time the use of simple transformations has become rather widespread. (See, e.g., ref. 6.) 
However, with the exception of reference 7, there apparently has been little effort made 
toward systematically studying and extending the earlier results. Moreover, with the 
exception of reference 5, there has been little reported computational experience with 
parameter transformations when used in conjunction with some of the best currently avail- 
able unconstrained minimization algorithms. 

In this report the transformation method is formulated and discussed as the problem 
of constructing a mappii^ whose domain is all of some Euclidean space and whose range 
is X. The equivalence of the original problem and the resulting transformed problem is 
demonstrated. Moreover, a variety of constraint regions X are considered correspond- 
ing, for example, to linear and quadratic inequality and equality constraints. In each case 
an appropriate transformation is constructed. In addition, the performance of the trans- 
formation method as a computational technique is studied by combining the method with the 
Davidon-Fletcher-Powell algorithm. The resulting algorithm is used to solve 19 con- 
strained minimization test problems. For each problem good performance is demon- 
strated by achieving rapid convergence to a solution from several widely separated start- 
ing points. 

SYMBOLS 


transpose of matrix A 

B*^,B^ set of all vectors in with ||x|| il 

C°° set of all functions with continuous partials of all orders 
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F,F(x) 


real valued function to be minimized 


f,f(z) real valued function defined by f(z) = F(6(z)) 

n,p positive integers 

R^,R^ set of all real vectors of dimension n and p, respectively 

X subset of R’^, the constraint region 

X n-dimensional vector with components Xj 

x° optimal (i.e., minimal) value of x 

z p- dimensional vector with components zj 

z° optimal (i.e., minimal) value of z 

spherical coordinates of data points (see appendix B) 

9 function relating z to x (i.e., x = 0(z)) with n components 6 ^ 

set of all vectors in R’^ with each component confined to the interval [-1,^ 
< , > inner (i.e., dot) product of two vectors 

II II Euclidean norm of a vector 

o denotes composition of two functions; for example, f = F o 0 is the function 

defined by f(z) = F(0(z)) 

Abbreviations: 

DFP Davidon- Fletcher- Powell algorithm 

DFP/T modification of Davidon- FI etcher-Powell algorithm 

FORMULATION 

As in the "Introduction," suppose that F is a real valued function defined for all 
values of x in R*^. Assume that a collection of equality and inequality constraints are 
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present and that X is the (nonempty) set of all those values of x which satisfy all con- 
straints (i.e., X is the feasible region). The problem of finding an (optimal) x° in X 
such that F(x°) ^ F(x) for all values of x in X will be referred to as the original (or 
constrained) problem. 

If 9 is a function mapping rP onto X, then the composition f= Fo0 (i.e., 
f(z) = F(0(z))) is a real valued function defined for all values of z in rP. As in the pre- 
vious paragraph, the second problem to consider is finding an optimal z° in RP such 
that f(z°) g f(z) for all values of z in rP. This second problem is called the trans- 
formed (or unconstrained) problem. 

As a simple example, consider the problem of minimizing F^xj,X 2 ^ subject to the 
constraint Xj2 + = 1. In this case n = 2 and X is the unit circle. To construct 

an equivalent unconstrained problem one can use the transformation xj = sin z and 
X 2 = cos z. In this case p = 1 and the transformed problem is as follows: minimize 
f(z) = F(sin ZjCos z) where z is now unconstrained. 

These two problems and, in general, any original problem and its associated trans- 
formed problem are equivalent in the following sense: 

If z in rP and x in X satisfy x = 0(z), then z is optimal for the trans- 
formed problem if and only if x is optimal for the original problem. 

The proof of this result is immediate but interesting since it demonstrates that 
equivalence is a consequence of the global nature of the optimization problems and that 
this is true independent of any continuity or differentiability requirements on F and 9. 
By construction, f(z) = F(6(z)) = F(x) whenever z in rP and x in X satisfy 
9{z) = X. Consequently, suppose z° is optimal for the transformed problem and let 
x° = 0(z°). Since 9 is onto, for any x in X, there is a z in rP with 9{z) = x. 
Moreover, since z° is optimal, f(z) S f(z°). Therefore, because f(z°) = F(x°), it fol- 
lows that F(x) g F(x°); that is, xO is optimal for the original problem. 

Conversely, if x° is optimal for the original problem and if z° satisfies 
0(zO) = xO, then zo is optimal for the transformed problem. If z is an arbitrary point 
in rP, then x = 0(z) in X satisfies F(x) ^ F(x°) and, consequently, f(z) g f(zi°). 

Thus, a parameter transformation neither introduces new (extraneous) global minima 
(for the original problem) nor does it eliminate old ones. In particular, if a global minima, 
say z°, has been obtained for the unconstrained problem, then the image 9(z°) is a 
global minimum for the original constrained problem. Moreover, if the constrained prob- 
lem has a solution — for example, this must be true if X is closed and bounded (com- 
pact) - then such a z° must exist. 

Consistent with the standard assumptions of nonlinear programing it is assmned 
that F and at least its first partials are continuous on an open set containii^ X. It also 
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is assumed that each component of Q is continuous with at least continuoxis first partials 
for all values of z in R^. With these assumptions, a parameter transformation is a 
generalized change of variables from to X. The generalization arises from the fact 
that — as the previous example illustrates — 0 need not be (and, in general, is not) one- 
to-one. It is this lack of one-to-oneness which permits a transformation between sets 
and x) which are, in general, not topologically equivalent. Specifically, in the pre- 
vious example X was the unit circle which is compact, whereas is not compact. 

TRANSFORMATION CONSTRUCTIONS 

For many nonlinear programing problems the construction of a parameter transfor- 
mation is impractical if not, in fact, impossible. However, in these situations it is fre- 
quently possible to effect a decomposition of the problem and thereby eliminate some, but 
not all, of the constraints. More will be said about this later. For the present, attention 
will be restricted to those situations where all the constraints are of the same form. 

It turns out that all the transformations constructed in this report are C°°. That is, 
each component of 9 is continuous with continuous partials of all orders. Thus, 
there is no loss of generality involved in formulating the question of the existence and 
construction of a parameter transformation as follows: 

Given a subset X of R”, construct a C°° function 6 mapping some Euclidean 
space rP onto X. By necessity X must be connected and, in general, althovigh not 
always, it is also compact. In most cases p is the dimension of the set X, althot^h in 
at least one important case this is not so. 

Upper and Lower Bound Constraints 

In R^, if X is compact and connected, then X must be an interval which without 
loss of generality may be taken as [-1,5 • example, since any one of the functions 

0(z) = sin ^ z (la) 

or 


or 
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is a C°® map from onto [-l,^,for n = 1 the question has an affirmative answer. 
For convenience, these functions have been normalized so that 0(-l) = -1 and 0(1) = 1. 

The functions immediately generalize, by way of a simple affine transformation, to 
the case where X = {a,l^-. In fact, the functions generalize to the case where X is the 
set of all X = ^xj, X 2 , . . which satisfy 

= xj = bj (i = 1, 2, , . n) (2) 


where the upper and lower limits bj and a^, respectively, are fixed. For example, using 
equation (la) yields 0 = (0j, 0£, . . ., where 


0 (z) = 



h + H 
2 


(i = 1, 2, . . ., n) (3) 


is a C°° map from R)' onto the right parallelepiped defined by expression (2). In a 
natural way, equation (3) generalizes further to the case where X is the set of all values 
of X in R*^ with 


X = 


w0 + 



( 4 ) 


where each pj can vary from 0 to 1. The points w^, w^, . . w*^ in R” are linearly 

independent, and w^ in R*^ is arbitrary. If X is given by equation (4), the function 
defined by 


n 

4>{z) = ^ 

j=l 

is a C°° map (in fact, an affine transformation) from R^ to R’^ which maps [jl,f| 
onto X. Here, 01,11'^ denotes the right parallelepiped defined by expression (2) in the 
case a: = -1 and b^ = 1. In this case the function defined by equation (3) maps R^ 
onto [-1,11 > taking the composition of this function with 0 yields a C°° map 
from r” onto X. That is, 

n 

0(z) = ^ ^ ^1 + sin ^ 

j=l 

is a C” map from R*^ onto the parallelepiped defined by equation (4). In component 
form. 
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( 5 ) 


n 

j=l 

where w| is the ith component of the vector w^. 

Quadratic Constraints 

Another generalization of equations (1), specifically of (lb), is given in the following 
discussion. Let Q be a real, symmetric, positive definite nxn matrix and let X be 
the set of x in with 

<x,Qx> 2 1 (6) 

Here, < , > denotes the inner product. Since Q is positive definite, X is convex 
and compact. In fact, in terms of the norm and inner product induced on by Q, 

X becomes the unit ball. This observation suggests 

(7) 

map from R*^ onto the set X given by expression (6). 
z in R’^ , 

0 S (1 - <z,Qz» 2 = (1 + <z,Qz»^ - 4<z,Qz> 


e(z) = ^ 

1 + <z,Qz> 

as a possible candidate for a C°° 
Notice that, for any value of 


Thus, 


<0(z),Q0(z)> 


4<z,Qz> 

(1 + <z,Qz»2 


and so 9 maps R“^ into X. To verify that the map is, in fact, onto, consider an arbi- 
trary point X in X and define z in R*^ as 


, ^ ( 8 ) 

1 + \/l - <x,Qx> 


Inserting z into equation (7) and performing the indicated operations yields, after some 
algebraic manipulation, 0(z) = x and, thus, 6 maps R*^ onto X. It is easily verified 
that 9 is C°°. In component form 9 is given by 


0i(z) 


2z| 

1 + <z,Qz> 


(9) 
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^ In the particular case where Q is the identity matrix, <z,Qz> reduces to 
llzll = zj^ + Z 2 ^ + . . . + Zjj^, and so 


0(z) = (10) 

1 + Ihll 

is a C°° map from onto the unit ball that is, the points x in R*^ with 
||x|l g 1. 

The previous results may be used to study a slightly more general quadratic con- 
straint; that is, X is all points x in R*^ with 


<x,Qx> + 2<a,x> ^ 1 


( 11 ) 


where a is a fixed vector in rI’. Since Q is positive definite, a positive definite 
inverse Q”^ exists. Define a second positive definite matrix 

1 


Q* = 


Q 


1 + <a,Q"^a> 

and let X* denote the set of all values of x in R^ with <x,Q*x>S 1. Then, 

2z 


6*{z) = 


1 + <z,Q*z> 


is a C°° map from R’^ onto X*. Moreover, the affine function 
y(z) = z - Q"^a 

maps X onto X and, consequently, X 
y o 0*. That is, 

0(z) = 2(1 + <a,Q~^a>)z 

1 + <a,Q"^a> + <z,Qz> 

is a C°° map from R*^ onto the set defined by expression (11), 

Linear Constraints 

All the parameter transformations previously constructed preserve the dimension of 
the constraint set X. That is, in each case the dimension of X was n and 0 was a 


is the image of R^ under the C°° function 
- Q'^a (12) 
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map from R” onto X. However, if X is a polytope with p+ 1 vertices, e becomes 
a map from rP onto X. Typically, although not necessarily, in this case p is larger 
than n. 

If X is a polytope, then it is the convex hull of p+1 vectors (vertices) 

V , v^, . . ., vP ^ in R“. Such a set is extremely important since it typically arises as 
the feasible region for a collection of linear inequalities. The set X consists of all 
vectors x of the form 


where 


P+1 

pjvj 

I 

j=l 

P+1 

Pj g 0 and 



j=l 


An equivalent representation is 


P 

X = vP"*" ^ ^ pj “ vP"*" 

i=i 


where Pj = 0 


and now 


P 


j-i 


Thus, the fimction 


P 

y(z) = vP"^^ + ^ " vP'*’ 

j=l 

is a C°° map from the unit ball onto X. This map, in composition with the map 

given by equation (10), yields a C°° map from R^ onto X. That is. 


0(z)= vP-^l + 



is a C*” map from rP onto the convex hull of the points v^, v^. 
In component form this map is 


(13) 


i,P+l 


in R 


n 


0i(z) = 



where v? 

1 


is the ith component of the vector v^. 


(14) 
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Equation (14) assumes a particularly simple form in the case where X is the 
region generated by the constraints 


xj s 0 (i = 1, 2, . . n) 

i 1 

i=l 

In this case p = n, the vertex is the origin, and for i = 1, 2, . . n the ver- 

tex v^ is the vector with l/a^ in the ith position and zeroes elsewhere. Conse- 
quently, equation (14) becomes 


(aj * 0) 


i 

1 

1 + 

11-11^ 


~i2 


0i(z) = 


Additional Constructions 

Suppose X is the set of all vectors x in which satisfy 


0 = ^1^1 ^ ^2^2 ^ ^ ^n^n (^^) 

where each (fixed) aj is positive. In this case X is closed and connected but not 
bounded. The dimension of X is n. The function 0 with components defined by 


®i(^) = ^(^1^ + Zg2 + . . . + Zj2j (10) 

is a C°° map from onto X. This is clearly true since 

aj0j(z) = Zj2 > 0 

and, for i = 2, 3, . . ., n, 

ai 0 i(z) - ai_i9i_i(z) = Zi2 ^ o 


Linear Equality Constraints 

Consider now the situation where X is defined by the system of linear equality 
constraints 
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Ax = b 


(17) 


Here, x is a (column) vector in b is a fixed (column) vector in and A is 

an mXn matrix with m < n. That is, X is the hyperplane of all vectors x in R*' 
which satisfy equation (17). Let p (where p 5 n - m) be the dimension of the null space 
of A and assume that X is not empty; that is, b is in the range of A. In this case 
there are p linearly independent vectors y^, y^, . . yP in R*^ which form a basis 
for the null space of A, and there is a vector c in R^ with Ac = b. Since any 
point in X has the representation 

P 

X = C + J Mjyj 

j=l 

^where pj is a scalar^ , it follows that 

P 

0(z) = c + ^ Zjy) (18) 

j=l 

is a C°° (in fact, an affine) map from R^ onto X. In component form this map is 
given as 


P 

0i(z) = Ci + ^ Zjy{ 

j=l 


(19) 


where again the subscript 


denotes the ith component of the vectors c and y^. 


Quadratic Equality Constraints 

Finally, in let X be the surface of an n dimensional ellipse, that is, the set 

of all values of x in such that 



where each value of a^^ is positive. Using generalized spherical coordinates pro- 
vides a map from R^“^ (i.e., p = n- 1) onto X. Namely, the function is 

e = ^2? • • ^n) where 
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0j(z) = sin z-^ 


(m= 1)^1 


= am cos zj cos Z 2 . . . cos Zm_l sin z^ (2 g m £ n - 1) > (20) 


dji(z) = an cos Zj cos Z 2 . . . cos Zj ^_2 cos Zj^_j (m = n) J 

THE GENERAL NONLINEAR PROGRAMING PROBLEM 

In the situation where the constraint region is too complicated - in its entirety - to 
be represented by a parameter transformation, a decomposition may be possible. Specif- 
ically, consider the general nonlinear programing problem of minimizing F(x) where x 
is in R^ subject to the constraints 


Gj(x) = 0 

(i = 1, 2, . . ., R) 

Hj(x) £ 0 

(j = 1, 2, . . ., S) 

This is the original problem. 


Suppose Gj and Hj are indexed in such a manner that the constraint region aris 
ing from the last R-r equality constraints and S-s inequality constraints can be rep- 
resented by a parameter transformation. That is, let X be the set of points x in R*' 
for which 

Gj(x) = 0 
and 

Hj(x) £ 0 

(i = r + 1, . . ., R) 
(j = s + 1, . . S) 


and suppose that 6 is a C” map from R^ onto X. 

As before, the transformed problem is constructed by defining the functions 


(i = 1, 2, . 
(j = 1, 2, . 


r) 

s) 
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f(z) = F(9{z)) 
gj(z) = Gj(6>(z)) 
hj(z) = Hj(0(z)) 



where z is in R^. The transformed problem reads: minimize f(z) where z is 
in rP subject to the constraints 


gj(z) = 0 

(i = 1, 2, . . ., r) 

hj(z) g 0 

(j = 1, 2, . . ., s) 


Again, it is easy to prove that these two problems are equivalent in the sense that if 
X = 9{z) then x is optimal for the original problem if and only if z is optimal for the 
transformed problem. The proof is omitted. 

The rest of this report is devoted to computational considerations. However, there is 
an interesting aspect of parameter transformations v/hich should be mentioned - namely, 
their use as a conceptual device to relate the methods of constrained and unconstrained 
optimization. As an example of this, a derivation of the Lagrange multiplier rule using a 
parameter transformation is presented in appendix A. 

TEST PROBLEMS AND RESULTS 

In order to explore the efficacy of parameter transformations as a computational 
technique, a total of 19 (constrained) nonlinear programing problems were solved. Six 
of these problems are constrained versions of the standard unconstrained test functions 
due to Rosenbrock and Wood. For three others the objective function is quadratic. An 
additional four are constrained test problems due to Box (ref. 5). Of the remaining six, 
one is a nonlinear least-squares problem, two are discrete formulations of a continuous- 
time optimal- control problem, two others are geometric problems, and the last is a prob- 
lem which Dixon (ref. 8) indicates many algorithms have failed to solve. 

The algorithm used to solve each of these 19 problems is a FORTRAN adaption of 
the original Davidon-Fletcher-Powell (DFP) algorithm (ref. 9) and will be denoted by 
DFP/T. To implement DFP/T the user must supply two subroutines: one which evaluates 
the n vector 0 and the nxp matrix dOfBz at z, and the other which evaluates F 
and its gradient 8F/8x at x = 0(z). In each case algebraic expressions for all these 
partials are available. The gradient 8f/8z is obtained by use of the chain rule. 

In order to use DFP/T, one must also supply an initial estimate of the solution in 
either z-space or in x-space. When x is supplied and not z, it also is necessary to 
supply a subroutine which solves the equation x = 0(z) for z (once). 

For each of the 19 test problems, convergence is achieved for several starting 
points. In each case, convergence means that both F and each component of the solution 
vector agree with their optimum values to at least five significant digits. The results 



presented are the number of iterations and the number of function evaluations required to 
achieve convergence. The number of function evaluations is the number of calls to the 
subroutine which evaluates F and its gradient 8F/9x. All calculations were performed 
on CDC 6000 series computers. 

Problems With Upper and Lower Bound Constraints 
A total of six test problems were solved with upper and lower bound constraints 

^ xj 5 bi (i = 1, 2, . . ., n) 

The results are presented in table I. In each case the parameter transformation given by 
equation (3) was used. In order of increasing value of n, these six problems were as 
follows: 

Rosenbrock (I) .- In the Rosenbrock (I) problem, 

F = 100^xi2 _ + ^1 - xjj^ 

with constraints 

-2 ^ Xj g 0.5 
-1 S X2 S 2 

The solution is F = 0.25 at the boundary point (0.5,0.25). 

Quadratic (I) .- In the Quadratic (I) problem, 

F = + 2x^ + Xg^ + ZxjXg + 2Xj^Xg - 8xj^ - Gxg - 4xg + 9 

with constraints 

0 ^ xj s 3 

0 ^ xg ^ 3 

0 i Xg 2 1.5 

The solution is F = 0 at the interior point (1,1,1). 
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NLS (Nonlinear Least Square).- In the NLS problem, 


108 

1 1 ['■iw-fli' 

i= 1 


with constraints 


0 5 Xj^ s 3500 
0^X2^ 3500 


0 ^ Xg 5 3500 


The function rj(x) is given by 



cos^0j sin^Xj 


• 2^x-l/2 
sm^ipA 


X<] 


where the 108 data points s^re listed in table V, appendix B. This is a nonlinear 

parameter estimation problem (n = 3) to determine the three ellipsoidal parameters of a 
nearly spherical body. The solution is F = 175.09 at the interior point (1740.9,1738.9, 
1736.1). 

Wood (I).- In the Wood (I) problem. 


F = 100(xj2 - X 2 )^ + (1 - ^l)^ + - X 4 )^ + (1 - Xg)^ 

+ 10.1 1(1 - xg)^ " ^ 4 )^ 19.8(1 - X 2 )(l - X 4 ) 


with constraints 

-4 ^ Xj = 0.5 

-2 g X 2 S 2 

-4 ^ Xg ^ 0.5 
-2 £ X 4 s 2 
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This problem has, in effect, two widely separated global minima: namely, F = 5.7419 
at the boundary point (-1.2748,1.6341,0.50000,0.26296) and F = 5.7425 at the boundary 
point (0.50000,0.26167,-1.2749,1.6354). The algorithm can converge to either point 
depending on the starting conditions. In those cases where convergence is to the latter 
point, the results are indicated by an asterisk. 

Rational.- In the Rational problem, 


F = 


Co - X 


(Cl + C2X2 + C3X3 + C4X4 + CgXgX 

Vl + d2X2 + d3X3 + d4X4 + dgXg) 


with constraints 


0 ^ Xj s 1 (i = 1, 2, . . 5) 

where 


0 

II 

0 

0 


Cl = 1 

di = 

0 

to 

II 

0 

d2 = 

Cg= -5 

d3 = 

C4 = 9 

d4 = 

‘^5 = -1 

^^5 " 


The form of this problem represents a modification of Box's problem A (ref. 5). How- 
ever, the coefficients are not those used by Box. The solution is F = 7.2857 at the cor- 
ner point (1,1, 0,1,1). 

Minimum Time (I) .- In the Minimum Time (I) problem. 



where Vq = 250, is defined by 

I 2 \ 1/2 

^i = (^i-1 2xiALi) 
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(i =■ 1, 2, . . ., 6) 



and is given by 


2ALj^ 

" V, + V, 


i-1 


(i = 1, 2, . . 6) 


The constants ALj are 

AL^ = ALg = 32 500 
ALg = AL4 = 65 000 
AL5 = ALg = 80 000 

and Vj = 800. This problem corresponds to a six-segment parameterization of a 
Min im um Time trajectory and is discussed in appendix C. The contraints are 

0 ^ x^ i 2 (i = 1, 2, . . 6) 

and the solution is F = 538.64 at the boundary point (2,2,2,0.53446,0,0). 

Problems With Quadratic Constraints 

A total of five test problems were solved with a quadratic inequality constraint of 
the form 



where aj^ and b^ are constants. The parameter transformation used is based on 
equation (10) and is given by 


0i(z) = ^ + ai 

1 + Ihll 

This transformation may be obtained by defining the intermediate variable 

Xi - a^ 
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in which case the inequality constraint becomes 


\\y\P ^ 1 - 


Using equation (10) yields 


yi = 


2Zj 
1 - 


from which it follows that 


2biZi 

*i = 2 ^i 

1 + llz ' 


The computational results for these five test problems are presented in table n. In order 
of increasing value of n, these problems were as follows: 

Rosenbrock (n) .- In the Rosenbrock (n) problem the same objective function as that 
in Rosenbrock (I) is used, but now the constraint is 



The solution is F = 0.043117 at the boundary point (0.79247,0.62732). 

Quadratic (II) .- In the Quadratic (n) problem the same objective function as that in 
Quadratic (I) is used, but now the constraint is 



The solution is F = 0 at the interior point (1,1,1). 

Wood (n) .- In the Wood (n) problem the same objective function as that in Wood (I) 
is used, but now the constraint is 



As with Wood (I) the problem has, effectively, two widely separated global minima: 
namely, F = 4.9812 at the boundary point (-1.1311, 1.2848,0.72903,0.54314) and 
F = 4.9821 at the boundary point (0.72899,0.54193,-1.1313,1.2858). Again, which of 
these two points the algorithm converges to is determined by the initial conditions. In 
those cases where convergence is to the latter point, the results are indicated by an 
asterisk. 
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Minimum Distance.- In the Minimum Distance problem the objective function is 


F= 2 

m= 1 

with the constraint 



This problem has the geometric interpretation of finding that point in the ellipsoid which 
is closest to (2, 2, 2, 2, 2). The solution is F = 0.12211 at the boundary point (1.6649, 
1.9042,1.9752,1.9937,1.9984). 

Mini mum Time (n) .- The problem in Minimum Time (II) is identical to that in 
Minimum Time (I) except that the constraints 0 g g 2 are replaced by the constraint 



The solution is F = 524,16 at the boundary point (2,5484,1.7752,1.6364,0.94378,0.25772, 
-0.42912). This problem has a neighboring minimum of F = 524.53 at the boundary point 
(2.5420,1.7720,1.6332,0.94315,0.25963,-0.42388), and for some initial conditions the algo- 
rithm converges to this latter point. 

Problems With Linear Constraints 

A total of seven problems were solved with linear inequality constraints; that is, the 
feasible region was the convex hull of a finite set of vertices. The results are presented 
in table HI. In each case the parameter transformation used is given by equation (14) and 
the vertices used to generate the feasible region are listed (as row vectors). In order of 
increasing value of n, these problems were as follows: 

Rosenbrock (ID) .- The objective function in the Rosenbrock (HI) problem is the same 
as that in Rosenbrock (I), but the constraints are 

X2 - 2xj 5 0 

X2 + 2xj - 4 £ 0 

*2 = 0 
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The feasible region is the triangle generated by the vertices (2,0), (1,2), and (0,0) and, thus, 
p = n = 2. The solution is F = 0 at the interior point (1,1). 

Box B .- In the Box B problem (ref. 5), 

r x^(xi - 6)x2^ 

27\/3 


with constraints 

xj g 0 

xj g ^2 = 0 
6 g \/3 X2 + Xj g 0 

The feasible region is the triangle generated by the vertices (6,0), (3,\/3), and (0,0) and, 
thus, p = 2. The solution is F = -1 at the vertex (3, \/3). 

Quadratic (in) .- The objective function in the Quadratic (in) problem is the same as 
that in Quadratic (I), but the constants are 

Xi g 0 (i = 1, 2, 3) 

Xf + X2 + 2xg ^ 3 

The feasible region is the three-dimensional simplex generated by the vertices (3,0,0), 
(0,3,0), (0,0, 1.5), and (0,0,0) and, so, p = 3. The solution is F = 1/9 at the boundary 
point (4/3, 7/9 ,4/9). 

POP (Post Office Parcel).- In the POP problem (ref. 5), 


F = -X 1 X 2 X 3 
with constraints 

0 g xj 5 42 
0 s X 2 S 42 
0 g X 3 £ 42 

0 g Xj + 2 X 3 + 2xg £ 72 
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The feasible region is depicted in figure 1 and is generated by the six indicated vertices 
(i.e., p = 5). The solution is F = -3456 at the boundary point (24,12,12). 



Figure 1.- Constraint region for POP problem. 
Modified POP.- In the Modified POP problem (ref. 5), 

F = -X 1 X 3 X 3 
with constraints 

0 s Xj s 20 
0 s X2 5 11 
0 g Xg S 42 

0 £ Xj + 2xg + 2xg £ 72 
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The feasible region is depicted in figure 2 and is generated by the eight indicated vertices 
(i.e., p = 7). The solution is F = -3300 at the vertex (20,11,15). 



Wood (ni) .- The objective function in the Wood (HI) problem is the same as that in 
Wood (I), but the constraints are 

0 ^ 2x^ i Xg ^ X2 = Xj i 2 

The feasible region is the simplex generated by the five vertices (2,0, 0,0), (2, 2,0,0), 

(2, 2,2,0), (2, 2,2,1), and (0,0,0,0) and, thus, p = 4. The solution is F = 5.0406 at the 
boundary point (1.0542,1.0542,0.59805,0.29902). 

Maximum Product .- In the Maximum Product problem, 

F = -XjX2X3X4X5Xg 
with the constraints 

Xi 5 0 (i = 1, 2, . . ., 6) 
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and 


""l-" 2 ''2+ 3^3 


1 

4 ^4 


1 

5^5 


1 

6^6 


The feasible region is the simplex generated by the origin and the seven vectors 

vl = (1,0,0,0,0,0), v2 = (0,2,0, 0,0,0), . . ., v® = (0,0,0, 0,0,6), and v"^ = (0,0,0,0,0,0). 

The solution is F = -720 at the boimdary point (1,2,3,4,5,6). 


In tables I and n the x-space starting points are listed. In contrast, table HI lists 
the z-space starting points. For convenience, table IV provides the x-space starting 
points corresponding to those z-space starting points listed in table III. 


An Open Constraint Region 

The nineteenth problem solved involved a constraint region X, unlike any of those 
considered to this point: namely, it is open. This problem is referred to as RECIP in 
reference 8 and is as follows: 


F = 


(xi - 5)^ + + 



2 


with the constraint 

X£ - > 0 

This constraint generates a constraint region which is the interior of a parabolic valley 
lying with its bottom along the Xg-axis. The parameter transformation used to solve this 
problem is given by 

0l(z) = Zj^ 

© 2 ( 2 ) = + exp ^Z 2 ^ 

03(z) = Z3 

That 9 is, in fact, a map from R^ onto X follows from the observation that, if 
X = 0(z), then X 2 - = exp ^Z 2 ) ^ The solution is F = 16.50154 at (1.2348, 

1.5247,0) and is obtained in the limit as z — (1.2348,-“°,0). 

This problem illustrates just how beneficial a transformation can be. Dixon (ref. 8) 
tested 16 versions of popular vuiconstrained function-minimization routines (including DFP) 


23 



on RECIP and none succeeded in finding the correct answer. When applied to this problem, 
DFP/T quickly reduced the function value to F = 16.590 (in 7 iterations with 17 function 
evaluations) and converged to the solution listed in the previous paragraph in 26 iterations 
with 69 function evaluations. The starting point used was the one given in reference 8; 
namely, x = (2,5,1). 


COMPUTATIONAL EXPERIENCE 

In order to summarize the computational results, 19 test problems were solved 
using a total of 65 different starting points. In every case convergence was achieved. A 
discussion of such items as robustness and rate of convergence is superseded by the 
observation that DFP/T is, of course, not really a new algorithm but rather an established 
algorithm, namely, DFP, in a new coordinate system. Consequently, general comments 
pertinent to DFP also apply to DFP/T, provided the transformation x = 0(z) does not 
render the transformed problem badly scaled. 

The particular adaptation of DFP used herein involved the use of Davidon’s cubic 
interpolation (ref. 10) in the one- dimensional search in conjunction with a logic which guar- 
antees a function decrease at each iteration. Except for this guaranteed function decrease 
no additional attempt is made to perform an exact one- dimensional search. 

Since there are points at which the matrix 80/ 8z has less than maximum rank, one 
might anticipate that DFP/t will occasionally converge to false minima. In practice, one 
finds that this almost never happens provided, of course, that the initial estimate is not on 
the boundary of the constraint region. As evidence of this fact, several starting points are 
reported in tables I, II, and III for each of the first 18 test problems. 

Since DFP/T is an interior method (that is, the sequence of iterates remains interior 
to the constraint region), it is possible to construct starting points and constraints which 
will trap the algorithm into local but not global minima. For example, in Rosenbrock (I) 
if the starting point is (-1.2,1) and the second constraint is replaced by 0.5 ^ X 2 ^ 2, 
the algorithm will track the valley X 2 = x^^ and converge to the boundary point (-0.25, 
0.5). Such a phenomenon is not particularly bad, however, since it can be revealed by 
trying several starting points. 

In general, DFP/T performed quite well. For example, when applied to the common 
unconstrained test functions the number of iterations required for convergence compared 
favorably. That is, the presence of the constraints does not greatly increase the number 
of iterations required for convergence, and, in some cases, this number actually is 
decreased. For those three problems with a quadratic cost function the convergence was 
always rapid — as one would hope. Finally, for those problems (Box B, POP, and Modified 
POP) for which some comparable data are available (ref. 5), DFP/t was clearly superior. 


24 



Consequently, computational experience indicates that, for those problems where a 
parameter transformation is possible, its use should be strongly considered. 

CONCLUDING REMARKS 

The transformation method is not a general-purpose method applicable to all prob- 
lems. Instead, it is a fairly specialized one applicable only when the constraint region has 
a reasonably simple structure. However, the method is intuitively appealing and remains 
attractive since many important types of constraints give rise to constraint regions with 
simple structure. 

The transformation method allows for considerable ingenuity on the part of the user, 
and this is, in fact, the spirit in which the method is frequently discussed. However, the 
method is naturally formulated as the mathematical problem of constructing a mapping 
whose range is known. This formulation not only permits a systematic study of the method 
but it provides the mechanism for constructing complicated transformations as the com- 
position of a sequence of simple transformations. 

Langley Research Center 

National Aeronautics and Space Administration 
Hampton, Va. 23665 
July 29, 1975 
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APPENDIX A 

DERIVATION OF THE LAGRANGE MULTIPLIER RULE 

In deriving the Lagrange multiplier rule, consider the problem of minimizii^ a dif- 
ferentiable function F(x) subject to the constraints 

Ax = b 

where the column vectors x,b are in R^ and R™, respectively, the matrix A is 
m X n with m < n, and it is assumed that b is in the range of A, For simplicity, it 
is also assumed that the rank of A is m (i.e., the m rows of A are linearly inde- 
pendent). Equation (19) provides a transformation from the set of n constrained values 
of X to a set of n-m unconstrained values of z. That is, 

n-m 

Xi = ^i(z) = 2jy{ 

i=i 

If F(x) has a constrained minimum at, say, x°, then f(z) = F(0(z)) has an 
unconstrained minimum at, say, z°, where 0(z°) = x°. At z° it is necessary that 


0 

9z,, 


(k = 1, 2, , . n-m) 


However, 


8f y 8F ^^i 


= y 

4 


i=l 


and, consequently, at x°, the gradient 9F/ 9x (a column vector) is orthogonal to the 
null space of A; that is, at x° 


( 


■f)y^=o 
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for k= 1, 2, . . n-m. Therefore, dF/Bx is in the row space of A ^i.e., the range 
of A*^) and so there is a (coltunn) vector \ in such that at x° 


|F = A^x 
Bx 


The vector \ 


is, of course, the Lagrange multiplier for this problem. 
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APPENDIX B 


DESCRIPTION OF THE TEST PROBLEM NLS 





The purpose of this appendix is to describe the 
test problem NLS. By using a spherical coordinate 
system (as indicated in the accompanying sketch), 
measurements are made at various points 

on the surface of a nearly spherical body (e.g., the 
moon). If the body is asstimed to satisfy an elliptic 
model, the points on the surface satisfy the equation 


(Bl) 


where the (nearly equal) ellipsoidal parameters a,b,c are to be estimated. Using the 
relations 


X = p cos (f> cos \ 
y = p cos (p sin X 


z = p sin 4> 


in equation (Bl) yields the equation 


P = 


, o 2 9 9 9 

{ COS (p cos^X cos (p sin^'X sin'^cp 

a^ b^ c^ 


- 1/2 


(B2) 


For each measurement (PiAij<^'i)» equation (B2) yields a radius r^(a,b,c) which 
is to be compared with p^. Consequently, the parameters a,b,c may be estimated by 
minimizing the squared sum of residuals 


1 

2 


108 

I Ci - "if 


i=l 
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where 


( cos^<6. cos^\. cos^4>. sin^Xi sin^(^.\ 




■ 1/2 


The data were statistically generated for testing purposes by using ellipsoidal 

parameters felt to be characteristic of the moon. The data are listed in table V with p 
given in kilometers and Xj and given in degrees. 


APPENDIX C 


DESCRIPTION OF THE TEST PROBLEMS MINIMUM TIME (I) 
AND MINIMUM TIME (H) 


The purpose of this appendix is to describe the test problems Minimum Time (I) and 
Minimum Time (II). These problems model a point mass moving along a path consisting 
of n straight-line segments of length ALj. The initial velocity Vq is specified and the 
point is permitted to accelerate or decelerate at a constant (constrained) rate while 
traveling the length in time tj. 

Given the lengths ALj with i = 1, 2, . . n and the initial velocity Vq, 
the velocities and times are defined recursively — as a fimction of 
V = Vg, . . Vjjj - by the respective equations 




+ 2V.AL 


, 1/2 




T. 

1 


2ALj 


V. + V 


i-1 






(i — 2j . • * y n) 


The form of these equations is chosen so that V- = 0 does not have to be treated as a 
special case. 

The optimization problem is to find that (constrained) collection of accelerations or 
decelerations V^, . . •, which minimize the transit time plus a weighted squared 
deviation from a desired final velocity Vj. That is, the objective fimction is (n = 6) 



where Vj = 800 and K = 5. Calculation of the first partials of this function involves a 
straightforward but rather tedious process which yields 



k2 2Vj.i 





ALj 
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TABLE I.- SUMMARY OF DFP/T PERFORMANCE ON SIX TEST PROBLEMS 
WITH UPPER AND LOWER BOUND CONSTRAINTS 


Problem 

Starting points 
(x- space) 

Iterations 

Function 

evaluations 

Rosenbrock (I) 

(-1.2,1) 

21 

80 


(-0.4,1.6) 

7 

22 


(-1.5, -0.5) 

11 

57 


(0,0) 

8 

21 

Quadratic (I) 

(0.1,0.1,0.1) 

8 

24 


(1.5, 1.5, 1.5) 

6 

19 


(4/3,7/9,4/9) 

6 

13 


(2,1,0.5) 

6 

13 

NLS 

(1800,1700,1600) 

5 

11 


(1750,1700,1650) 

3 

7 


(1600,1700,1800) 

4 

9 

Wood (I) 

(-3,-l,-3,-l) 

*26 

*97 


(0,0,0,0) 

*20 

*58 


(-2,l,-2,-l) 

*24 

*90 


(0,1,0,-1) 

*21 

*73 

Rational 

(0.5, 0.5, 0.5, 0.5, 0.5) 

7 

16 


(0.9,0. 7,0. 5,0. 3,0.1) 

8 

20 


(0.1,0. 3,0.5,0.7,0.9) 

7 

20 


(0.8,0.8,0.2,0.8,0.8) 

7 

16 

Minimum 

(0.8,0.8,0.8,0.8,0.8,0.8) 

17 

53 

Time (I) 

(1,1,1,1,1,1) 

23 

70 


(1.8,1.5,1.2,0.9,0.6,0.3) 

18 

54 


(1.5,1.5,1.5,0.6,0.6,0.6) 

L 

20 

59 


*See discussion of Wood (I) problem in text. 
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TABLE II.- SUMMARY OF DFP/T PERFORMANCE ON FIVE TEST PROBLEMS 
WITH QUADRATIC INEQUALITY CONSTRAINTS 


Problem 

Starting points 
(x-space) 

Iterations 

Function 

evaluations 

Rosenbrock (n) 

(-1.2,1) 

23 

104 


(-1,-1) 

18 

94 


(0,0) 

16 

64 


(0.5,0) 

11 

38 

Quadratic (II) 

(0.1, 0.1, 0.1) 

10 

34 


(0,0,0) 

9 

34 


(4/3,7/9,479) 

10 

38 


(2,1,0) 

11 

39 

Wood (n) 

(-3,-1, -3,-1) 

*45 

*374 


(0,0,0,0) 

25 

98 


(-2,1, -2,-1) 

31 

209 


(-1.75,0,-1.75,0) 

*21 

*70 

Minimum 

(1,1, 1,1,1) 

13 

39 

Distance 

(0.0625,0.125,0.25,0.5,1) 

13 

38 


(0,0,0,0,0) 

13 

38 


(1,0.5,0.25,0.125,0.0625) 

15 

43 

Minimum 

(0.8,0. 8, 0.8,0. 8,0. 8,0. 8) 

16 

41 

Time (n) 

(1,1, 1,1, 1,1) 

16 

40 


(1.8, 1.5, 1.2,0. 9,0. 6,0. 3) 

16 

47 


(1.5,1.5,1.5,0.6,0.6,0.6) 

16 

44 


* See discussion of Wood (n) problem in text. 



TABLE m.- SUMMARY OF DFP/T PERFORMANCE ON SEVEN TEST PROBLEMS 


WITH LINEAR INEQUALITY CONSTRAINTS 

t' 

Problem 

Starting points 
(z-space) 

Iterations 

Function 

evaluations 


Rosenbrock (in) 

(0.7, 0.5) 

11 

71 



(0.5,0.7) 

11 

62 



(0.2,0.8) 

9 

52 

i 


(0.8, 0.2) 

7 

25 


Box B 

(0. 7,0.7) 

5 

13 



(0.5,0.7) 

4 

9 



(0.2,0.8) 

5 

11 



(0.7, 0.5) 

14 

31 


Quadratic (III) 

(0.5,0.5,0.5) 

7 

15 



(0.2, 0.4, 0.6) 

9 

27 



(0.7,0.5,0.3) 

7 

15 


POP 

(0.4,0.4,0.4,0.4,0.4) 

7 

15 



(0.2,0.2,0.4,0.4,0.6) 

9 

19 



(0.6,0.6,0.2,0.2,0.2) 

10 

21 


Modified 

(0.35,0.35,0.35,0.35,0.35,0.35,0.35) 

13 

32 


POP 

(0.2,0.2,0.2,0.4,0.4,0.5,0.5) 

13 

32 



(0.5,0.4,0.3,0.2,0.2,0.2,0.2) 

13 

33 


Wood (m) 

(0.6,0.5,0.3,0.2) 

16 

44 

' 


(0.2,0.2,0.2,0.2) 

14 

35 

;j 


(0.4,0.5,0.5,0.4) 

(0.2,0.3,0.5,0.7) 

17 

16 

62 

48 

If 

1 

Maximum 

(0.2,0.2,0.3,0.3,0.5,0.5) 

5 

12 

1 

Product 

(0.5,0.5,0.3,0.3,0.2,0.2) 

5 

12 

M- 

m 


TABLE IV.- THE x-SPACE AND z-SPACE STARTING POINTS FOR 
SEVEN TEST PROBLEMS WITH LINEAR CONSTRAINTS 


Problem 

Starting points 
(z-space) 

Starting points 
(x- space) 

Rosenbrock (IH) 

(0.7, 0.5) 

(1.63,0.66) 


(0.5, 0.7) 

(1.31,1.29) 


(0.2,0.8) 

(1.02,1.81) 


(0.8,0.2) 

(1.87,0.11) 

Box B 

(0.7,0.7) 

(4.50,0.87) 


(0.5,0.7) 

(3.93,1.12) 


(0.2,0.8) 

(3.06,1.57) 


(0.7,0.5) 

(4.88,0.57) 

Quadratic (m) 

(0.5,0.5,0.5) 

(0.98,0.98,0.49) 


(0.2,0.4,0.6) 

(0.120,0.79,189) 


(0.7,0.5,0.3) 

(1.76,0.90,0.16) 

POP 

(0.4,0.4,0.4,0.4,0.4) 

(24.89,10.07,10.07) 


(0.2,0.2,0.4,0.4,0.6) 

(13.02,8.21,19.84) 


(0.6,0.6,0.2,0.2,0.2) 

(37.71,8.08,2.41) 

Modified POP 

(0.35,0.35,0.35,0.35,0.35,0.35,0.35) 

(11.36,6.25,14.49) 


(0.2,0.2,0.2,0.4,0.4,0.5,0.5) 

(5.95,5.73,21.27) 


(0.5,0.4,0.3,0.2,0.2,0.2,0.2) 

(15.68,5.27,7.01) 

Wood (m) 

(0.6,0.5,0.3,0.2) 

(1.96,1.00,0.34,0.05) 


(0.2,0.2,0.2,0.2) 

(0.95,0.71,0.48,0.12) 


(0.4,0.5,0.5,0.4) 

(1.98,1.59,0.99,0.19) 


(0.2,0.3,0.5,0.7) 

(1.99,1.90,1.69,0.56) 

Maximum 

(0.2,0.2,0.3,0.3,0. 5,0.5) 

(0.31,0.62,2.09,2.79,9.68,11.62) 

Product 

(0.5,0. 5,0. 3,0.3,0.2,0.2) 

(1.94,3.87,2.09,2.79,1.55,1.86) 
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TABLE V.- INPUTS FOR THE TEST PROBLEM NLS 


Pi, 


<Pi> 




Pi’ 



km 

deg 

deg 

km 

deg 

deg 

km 

deg 

deg 

1737.77 

149.541 

-86.453 

1738.63 

173.850 

-83.543 

1737.81 

-172.550 

-80.418 

1738.41 

-162.013 

-77.227 

1738.59 

-152.740 

-73.997 

1737.62 

-144.111 

-70.739 

1738.39 

-135.863 

-67.452 

1737.56 

-127.863 

-64.136 

1737.92 

-120.040 

-60.791 

1737.14 

-112.350 

-57.414 

1738.49 

-104.767 

-54.006 

1736.63 

-97.272 

-50.565 

1737.29 

-89.854 

-47.091 

1737.39 

-82.503 

-43.584 

1737.66 

-75.212 

-40.046 

1737.71 

-67.974 

-36.476 

1737.77 

-60.784 

-32.877 

1738,27 

-53.637 

-29.251 

1739.09 

-46.529 

-25.600 

1738.92 

-39.454 

-21.927 

1739.77 

-32.408 

-18.233 

1739.54 

-25.387 

-14.523 

1739.86 

-18.386 

-10.800 

1740.05 

-11,399 

-7.067 

1741.25 

-4.423 

-3.327 

1741.26 

2.547 

.416 

1741.13 

9.517 

4.159 

,1741.02 

16.490 

7.897 

1740.88 

23.472 

11.628 

1740.11 

30.468 

15.349 

1740.83 

37.482 

19.055 

1739.88 

44.518 

22.745 

1738.70 

51.582 

26.416 

1739.68 

58.678 

30.064 

1738.08 

65.811 

33.688 

1739.10 

72.986 

37.286 

1737.77 

80.207 

40.856 

1737.72 

87.480 

44.397 

1736.45 

94.811 

47.908 

1737.47 

102.209 

51.389 

1736.86 

109.683 

54.839 

1736.18 

117.246 

58.259 

1735.-73 

124.918 

61.650 

1735.00 

132.727 

65.012 

1734.26 

140.722 

68.347 

1735.00 

148.983 

71.655 

1735.15 

157.663 

74.936 

1734.51 

167.086 

78.188 

1734.94 

178.053 

81.400 

1734.87 

-166.825 

84.529 

1734.91 

-133.977 

87.314 

1734.22 

-142.465 

86.400 

1734.15 

-152.161 

82.956 

1734.30 

-150.821 

79.318 

1734.31 

-146.664 

75.639 

1733.70 

-141.395 

71.951 

1734.13 

-135.571 

68.267 

1734.55 

-129.426 

64.595 

1734.55 

-123.072 

60.938 

1733.78 

-116.572 

57.301 

1734.63 

-109.962 

53.686 

1734.83 

-103.265 

50.097 

1733.79 

-96.495 

46.534 

1735.31 

-89.662 

42.999 

1734.81 

-82,773 

39.494 

1735.79 

-75.835 

36.018 

1735.28 

-68.852 

32.572 

1736.37 

-61.827 

29.156 

1737.29 

-54.766 

25.768 

1736.55 

-47.672 

22.406 

1737.40 

-40.548 

19.070 

1738.23 

-33.399 

15.757 

1738.90 

-26.228 

12.463 

1739.56 

-19.041 

9.186 

1739.92 

-11.840 

5.921 

1740.47 

-4.631 

2.667 

1740.97 

2.582 

-.583 

1742.12 

9.794 

-3.831 

1741.65 

17.001 

-7.081 

1741.71 

24.198 

-10.339 

1742.08 

31.381 

-13.607 

1740.70 

38.545 

-16.889 

1742.60 

45.686 

-20.189 

1741.42 

52.800 

-23.511 

1741.58 

59.883 

-26.856 

1740.64 

66.930 

-30.227 

1741.01 

73.939 

-33.627 

1741.50 

80.904 

-37.056 

1739.78 

87.821 

-40.515 

1740.29 

94.685 

-44.005 

1740.66 

101.489 

-47.525 

1738.78 

108.226 

-51.075 

1739.82 

114.881 

-54.653 

1738.96 

121.440 

-58.259 

1739.47 

127.873 

-61.888 

1738.84 

134.137 

-65.538 

1739.44 

140.156 

-69.206 

1739.38 

145.786 

-72.885 

1738.34 

150.720 

-76.567 

1737.56 

154.195 

-80.234 

1738.71 

153.672 

-83.836 

1738.08 

135.133 

-87.080 

1738.39 

91.990 

-87.938 

1738.41 

-176.064 

-.101 

1736.86 

-85.962 

-2.068 

1742.05 

4.063 

-.031 

1740.50 

93.963 

1.932 

1734.60 

-85.923 

88.062 
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